这是我从网上搜集的一些语料库, 主要是一些跨语言配对句子数据, 可以用于机器翻译的学习项目, 因为很多人缺少数据, 所以我在这里列出来, 希望对大家有帮助。这些语料可能不适合工业界, 更适合学习目的的项目。
数据格式
所有文件格式都一样, 每行都是句子1 tab 句子2, 例如:
1 | Tom broke the window. 汤姆打破了窗户。 |
关于这些语料的更多信息
- 我们网站的这一部分使用了Tatoeba项目的句子。 （阅读关于Tatoeba项目）
- 我试图过滤掉可能令人反感并且不适合所有年龄和文化的句子。如果您发现应删除的内容，请在微博@该用户已经被封 向我发送“错误报告”。
- 这些句子按长度排序，首先是最短的句子。
下面是不同语言的句子对
Afrikaans - English afr-eng.zip (716)
Algerian Arabic - English arq-eng.zip (157)
Arabic - English ara-eng.zip (10742)
Azerbaijani - English aze-eng.zip (2091)
Basque - English eus-eng.zip (656)
Belarusian - English bel-eng.zip (2520)
Bengali - English ben-eng.zip (4379)
Berber - English ber-eng.zip (34935)
Bulgarian - English bul-eng.zip (14976)
Cantonese - English yue-eng.zip (3035)
Catalan - English cat-eng.zip (623)
Chavacano - English cbk-eng.zip (1904)
Chinese (Mandarin) - English cmn-eng.zip (20133)
Chuvash - English chv-eng.zip (195)
Croatian - English hrv-eng.zip (1240)
Czech - English ces-eng.zip (7634)
Danish - English dan-eng.zip (14839)
Dutch - English nld-eng.zip (28224)
Estonian - English est-eng.zip (1550)
Finnish - English fin-eng.zip (49208)
French - English fra-eng.zip (155507)
Galician - English glg-eng.zip (126)
Georgian - English kat-eng.zip (125)
German - English deu-eng.zip (170297)
Greek - English ell-eng.zip (14485)
Hebrew - English heb-eng.zip (126137)
Hindi - English hin-eng.zip (2867)
Hungarian - English hun-eng.zip (54197)
Icelandic - English isl-eng.zip (6664)
Indonesian - English ind-eng.zip (6702)
Italian - English ita-eng.zip (297241)
Japanese - English jpn-eng.zip (42866)
Khasi - English kha-eng.zip (645)
Khmer - English khm-eng.zip (433)
Korean - English kor-eng.zip (773)
Latvian - English lvs-eng.zip (715)
Lithuanian - English lit-eng.zip (2056)
Low Saxon - English nds-eng.zip (3269)
Macedonian - English mkd-eng.zip (62522)
Malay - English zsm-eng.zip (133)
Malayalam - English mal-eng.zip (553)
Maori - English mri-eng.zip (204)
Marathi - English mar-eng.zip (31262)
North Moluccan Malay - English max-eng.zip (176)
Norwegian (Bokmål) - English nob-eng.zip (5623)
Persian - English pes-eng.zip (1952)
Polish - English pol-eng.zip (36928)
Portuguese - English por-eng.zip (121267)
Romanian - English ron-eng.zip (7854)
Russian - English rus-eng.zip (306408)
Serbian - English srp-eng.zip (9380)
Slovak - English slk-eng.zip (575)
Slovenian - English slv-eng.zip (296)
Spanish - English spa-eng.zip (119155)
Swedish - English swe-eng.zip (17300)
Tagalog - English tgl-eng.zip (3142)
Tamil - English tam-eng.zip (180)
Tatar - English tat-eng.zip (482)
Thai - English tha-eng.zip (110)
Turkish - English tur-eng.zip (475907)
Ukrainian - English ukr-eng.zip (84673)
Urdu - English urd-eng.zip (1181)
Uyghur - English uig-eng.zip (284)
Vietnamese - English vie-eng.zip (3412)
